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[57] ABSTRACT 

An associative optical memory including an input SLM 
in the form of an edge enhanced LCLV and a pair of 
memory SLMs in the form of LCTVs forms a matrix 
array of an input image which is cross correlated with a 
matrix array of stored images. The correlation product 
is detected and non-linearly amplified to illuminate a 
replica of the stored image array to select the stored 
image correlating with the input image. The LCLV is 
edge enhanced by reducing the bias frequency and volt- 
age and rotating its orientation. The edge enhancement 
and non-linearity of the photodetection improves the 
orthogonality of the stored images. The illumination of 
the replicate stored image provides a clean stored im- 
age, uncontaminated by the image comparison process. 

17 Claims, 1 Drawing Sheet 
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OPTOELECTRONIC ASSOCIATIVE MEMORY 

ORIGIN OF THE INVENTION 

The invention described herein was made in the per- 5 
formance of work under a NASA contract, and is sub- 
ject to the provisions of Public Law 96-517 (35 USC 
202) in which the Contractor has elected not to retain 
title. 
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TECHNICAL FIELD 

The present invention relates to optoelectronic asso- 
ciative memories and, in particular, to an optical imple- 
mentation of a spatial light modulator based Hopfield 
type optical associative memory. 15 

BACKGROUND OF THE INVENTION 

Techniques for image recognition and comparison 
using optical associative memory configurations have 
been proposed, such as the one known as the Hopfield 20 
type described in the publication by J. J. Hopfield, 
“Neural networks and Physical systems with emergent 
collective computational abilities”, Proc. Natl Acad 
ScL U.S.A. 79, 2554 (1984). 

It is known that the Hopfield associative memory 25 
model is more effective for orthogonal memory images. 
However, real-world images, such as cars or airplanes, 
usually contain lots of common parts so that the associa- 
tive recall of a complete image using a corrupted partial 
image input is relatively difficult. 30 

What is needed is an implementation of a Hopfield 
type associative memory that can improve the success 
rate of associative optical recall even with partial and- 
/or corrupted input images. 

BRIEF STATEMENT OF THE INVENTION 35 

The preceding and other shortcomings of the prior 
art are addressed and overcome by the present inven- 
tion that provides, in a first aspect, a method for selec- 
tively retrieving a stored image from a plurality of 40 
stored images by displaying an input image with a first 
SLM, forming a first matrix array including replications 
of the input image on a second SLM, forming a second 
matrix array including stored images on the second 
SLM, forming a third matrix array of stored images on 45 
a third SLM related to the second matrix array, and 
selectively illuminating the third SLM to select an 
image in the third matrix array in response to correla- 
tion in the second SLM between a corresponding image 
in the second matrix array and the input image. 50 

In a further aspect, the present invention provides a 
system for selectively retrieving a stored image from a 
plurality of stored images having a first SLM for dis- 
playing an input image, a second SLM, means for form- 
ing a first matrix array on the second SLM including 55 
replications of the input image displayed on the first 
SLM, means for forming a second matrix array includ- 
ing stored images on the second SLM, a third SLM, 
means for forming a third matrix array of stored images 
on the third SLM related to the second matrix array, 60 
and means for selectively illuminating the third SLM to 
select an image in the third matrix array in response to 
correlation in the second SLM between a correspond- 
ing image in the second matrix array and the input im- 
age. 65 

These and other features and advantages of this in- 
vention will become further apparent from the detailed 
description that follows which is accompanied by a set 
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of drawing figure(s). In the figures and description, 
numerals indicate the various features of the invention, 
like numerals referring to like features throughout both 
the drawings and the description. 

BRIEF DESCRIPTION OF THE DRAWING(S) 

FIG. 1 is a functional block diagram of a spatial light 
modulator based optoelectronic associative memory 
according to the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

FIG. 1 is a functional block diagram of spatial light 
modulator — or SLM — based optoelectronic associative 
memory 10 according to the present invention. Associa- 
tive memory 10 includes processor 12, monitor 14 and 
memory 16 all of which may conveniently be parts of a 
conventional microprocessor computer system. The 
stored images are contained in memory 16 and are dis- 
played for comparison, as will be described in more 
detail below, under the control of processor 12. 

The object image input is provided by input subsys- 
tem 18 which may be any convenient source of the 
image to be recognized. A dotted line relationship be- 
tween input subsystem 18 and processor 12 is shown to 
indicate that in some embodiments, the object image to 
be analyzed and recalled may be stored in memory 16 
and provided by input subsystem 18 under the control 
of processor 12. 

The following simplified overview of the operation 
of associative memory 10 will first be presented for 
clarity of understanding. A more detailed description of 
the complete system will then be presented. 

The image to be analyzed is retrieved from input 
subsystem 18 and an edge enhanced version thereof is 
replicated to form a matrix array of identical images. A 
similar matrix array of memory images is formed from 
stored images retrieved from memory 16 and superim- 
posed upon the matrix of input images to optically cor- 
relate them to determine the most accurate match, if 
any. 

The difference in light values between accurate and 
inaccurate matches resulting from the optical cross 
correlation is exaggerated with a non-linear photode- 
tection system and then used to control a light source 
array to illuminate a second, related or identical matrix 
of memory images to selectively project the corre- 
sponding stored image for further processing, such as 
by redisplay on monitor 14. 

In particular, the input or object image is retrieved 
under the control of processor 12 from any convenient 
source, such as memory 16. The input image may be 
only a partial image and/or a corrupted image. The 
operation of associative memory 10 will permit the 
retrieval of a complete and uncorrupted version of the 
input image if such a version is stored in the stored 
images within memory 16 and can be selected by com- 
parison with the input image. 

For convenience of pictorial display and explanation, 
the object or input image is shown in FIG. 1 as the letter 
“A” although in actual operation the image represented 
in the FIGURE as input image A might be a partial 
and/or corrupted image of an enemy airplane or any 
other image for which comparison by optical associa- 
tive memory is required. 

The object image is applied by input subsystem 18 to 
a suitable gray scale SLM display device or subsystem 
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which, as shown in FIG. 1, may conveniently be a 
liquid crystal light valve — or LCLV — such as LCLV 
20, driven by a cathode ray tube— or CRT— such as 
CRT 22. Input image A is shown in FIG. 1 on the face 
of LCLV 20. 5 

In an actual implementation of associative memory 
10, a XYTRON CRT was utilized as CRT 22 and a 
Hughes CdS LCLV was utilized as LCLV 20 to form 
an input SLM. The use of an LCLV, such as the 
Hughes CdS LCLV, as the input SLM is particularly 10 
advantageous when the LCLV is used in a real time 
edge enhancement mode as described in greater detail 
below. 

A source of coherent light from a low power laser, 
such as laser 24, is applied to LCLV 20 by reflection 15 
from polarizing beam splitter 26. Laser 24 may conve- 
niently be a 632.8 nm He-Ne laser. The light then re- 
flected from LCLV 20 through polarizing beam splitter 
26 includes input image A and is focussed by optical 
lens 28 on a device for forming a matrix of such images, 20 
such as binary diffraction grating optics 30. Diffraction 
grating optics 30 serves to form a matrix of M rows and 
N columns of identical replications of input image A. 
For the purposes of this illustration, M is shown as equal 
to N which is equal to 2, so that input image A is repli- 25 
cated four times. In a practical implementation of asso- 
ciative memory 10 in accordance with this invention, it 
may well be convenient for M and N to be substantially 
larger numbers. 

The matrix output of diffraction grating optics 30 is 30 
applied by optical lens 32 to the first of a pair of optical 
memories, such as liquid crystal television — or 
LCTV— SLMs 34 and 36. In particular, the matrix 
output from diffraction grating optics 30 is applied to 
one surface, separately identified for clarity as first sur- 35 
face 35, of LCTV SLM 34. That is, a matrix consisting 
of replications of input image A — hereafter called input 
image matrix AAAA — is applied to LCTV SLM 34. 

In addition, a different matrix of images, shown in the 
FIGURE as a 2 X 2 matrix consisting of the letters A, B, 40 
C, and D and referred to hereinafter as stored image 
matrix ABCD, is formed in LCTV SLMs 34 and 36. 
For clarity of explanation and depiction, stored image 
matrix ABCD is shown as being formed on separated 
second surface 37 of LCTV SLM 34 but, in actual prac- 45 
tice, input image matrix AAAA is superimposed on 
stored image matrix ABCD in LCTV SLM 34. The 
utilization of stored image matrix ABCD formed in 
LCTV SLM 36 will be described below. 

Each LCTV SLM 34 and 36 may conveniently be a 50 
model 3ML100 Sharp TFT active matrix LCTV. The 
size and configuration of the matrices formed in LCTV 
SLMs 34 and 36 are dependent on the size and configu- 
ration of the input matrix. That is, stored image matrix 
ABCD should have the same number of elements, of 55 
about the same size and relative position, as input image 
matrix AAAA. As noted above, the matrices shown in 
the FIGURE are all 2 X 2 matrices for convenience. 

Stored image matrix ABCD is formed in LCTV 
SLMs 34 and 36 under the control of processor 12 from 60 
images stored in memory 16. If the number of stored 
images to be compared to input image A is greater than 
the resolution of stored image matrix ABCD, multiple 
matrices of stored images may be sequentially pro- 
cessed. Alternately, the association of one of a series of 65 
stored images to input image A may be used as part of 
the selection criteria for the selection of stored images 
to be used in a subsequent stored image matrix. 
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In any event, the superposition of input image matrix 
AAAA and stored image matrix ABCD on or in LCTV 
SLM 34 acts as a form of image association or correla- 
tion as part of the process of image recognition by com- 
parison. If a stored image in stored image matrix ABCD 
is substantially similar to one of the replications of input 
image A in input image matrix AAAA, the light trans- 
mitted through LCTV SLM 34 at that image location 
originating from laser 24 will be substantially greater 
than the light transmitted through LCTV SLM 34 at all 
other image locations. 

In the example shown in the FIGURE, input image A 
in the upper left corner of input image matrix AAAA 
shown on first surface 35 will be transmitted faithfully 
through LCTV SLM 34 at the stored image of the letter 
A in the upper left hand comer of stored image matrix 
ABCD shown on second surface 37. This ray of light 
will be substantially brighter than the rays resulting 
from the superposition of input image A of other stored 
images, such as the letters B, C or D, at other locations 
of stored image matrix ABCD. 

The light transmitted through LCTV SLM 34 is 
applied by lenslet array 38 to photodetector array 40. 
For simplicity, and to emphasize the discrimination of 
the location of the matrices in which corresponding 
images are applied, the light ray resulting from the 
correlation of input image A and stored image A is 
shown as a thicker ray, although the partial cross corre- 
lation of input image A with other stored images in 
stored image matrix ABCD may result in lower value 
light rays also being applied to photodetector array 40. 

The output of each photodetector in photodetector 
array 40 is applied to non-linear amplifier subsystem 42 
which drives light source matrix array 44. As will be 
described below in greater detail, the light source in 
light source matrix array 44 in the matrix location in 
which there is substantial correlation between input and 
stored images occurred in LCTV SLM 34 will be illu- 
minated more brightly than those for other locations. 
Light from light source matrix array 44 is then applied 
by lenslet array 46 to LCTV SLM 36. 

As noted above, stored image matrix ABCD is ap- 
plied to LCTV SLM 36 in the same manner as it is 
applied to LCTV SLM 34. In this way, the light result- 
ing from positive correlation between input and stored 
images is then used to illuminate a duplicate of the 
stored image to complete the associative recall process. 
The stored image of the letter A in the upper left hand 
comer of stored image matrix ABCD is thereby illumi- 
nated by the appropriate light source in light source 
matrix array 44 more strongly than the other stored 
images in that array so that the image provided for 
further processing more closely resembles the input 
image. 

As shown in the FIGURE, the corresponding image, 
if one exists, is applied by the strong illumination of the 
corresponding location to mirror array 48 together with 
less strongly illuminated images which did not correlate 
was well with the input image. Mirror array 48 is an 
array of individual mirrors, each corresponding to a 
specific location of the matrix array of LCTV SLM 36 
and pivoted or tilted so that a light ray from each such 
location is imaged by optical lens 50 to a predetermined 
central location on an image photodetector, such as 
charge couple detector — or CCD — camera 52. CCD 
camera 52 then provides the image received from mir- 
ror array 48 to processor 12 for thresholding and feed- 
back operations. 
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In many cases, further iteration of the associative 
memory loop is used to further enhance the retrieved 
image, especially for partial and/or corrupted input 
images. Processor 12 provides a thresholding function 
which selects or identifies the memory image array 5 
applied to LCTV SLM 36 that provides a signal above 
a predetermined threshold indicating a predetermined 
degree of correlation between one element of that array 
and the input image. 

Once the threshold level has been achieved, the input 10 
image in input subsystem 18 is replaced by the output of 
CCD camera 52 under the control of processor 12 and 
reapplied by CRT 22 to LCLV 20 for re-correlation 
with stored image matrix ABCD. The output of CCD 
camera 52 which exceeds the threshold value as deter- 15 
mined by processor 12 is also displayed of monitor 14. 

The image then applied to CCD camera 52 will, of 
course, show enhanced correlation with input image A. 
Further iterations may be utilized to provide additional 
image enhancement until the image displayed on moni- 
tor 14 is substantially an uncontaminated version of the 
one of the images stored in memory 16. 

In summary, the operation of associative memory 10 
provides for the comparison of an input image, which ^ 
may be only a partial and/or corrupted image, with 
multiple stored images to select and then present a clean 
copy of a corresponding image if available. 

As noted above, associative optical memories such as 
the Hopfield type model described herein, are more 3Q 
effective for orthogonal memory images. To enhance 
the discrimination capabilities of associative memory 
10, LCLV 20 may conveniently be operated in an edge 
enhancement mode and amplifier subsystem 42 may be 
implemented to provide a non-linear transfer function 35 
between light intensities detected by photodetector 
array 40 and the strength of illumination generated by 
the individual sources in light source matrix array 44. 

In particular, the operation of a particular LCLV in 
an edge enhancement mode is described in detail in an 4 0 
article by the inventor hereof entitled “Real time opti- 
cal edge enhancement using a Hughes liquid crystal 
light valve”, published in APPLIED OPTICS , Vol. 28, 
No. 22, Nov. 15, 1989, the text of which is incorporated 
herein by this reference. 45 

In the preferred embodiment shown in the FIGURE, 
LCLV 20 is an edge enhanced spatial light modulator 
configured from a Hughes CdS liquid crystal light 
valve operated at a relatively low bias frequency, on the 
order of about 500 Hz to about 2 kHz, and a relatively 50 
low bias voltage, on the order of about 5 to about 7 volts 
rms. The nominal bias frequency and voltages are 10 
kHz and 10 volts rms. In addition, the orientation of 
LCLV 20 may be rotated counterclockwise, as ob- 
served from the readout side, in the range of about 10° 55 
to about 30°. 

With regard now to the operation of amplifier subsys- 
tem 42, non-linear amplifiers, such as operational ampli- 
fiers operated in a non-linear mode, may be used to 
further enhance the discrimination capabilities of asso- 60 
ciative memory system lo by non-linearly increasing the 
intensity of illumination generated by the correspond- 
ing light source in light source matrix array 44 when 
compared to the intensity of light detected at the vari- 
ous matrix locations by photodetector array 40. 65 

While this invention has been described with refer- 
ence to its presently preferred embodiment, its scope is 
not limited thereto. Rather, such scope is only limited 
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insofar as defined by the following set of claims and 
includes all equivalents thereof. 

What is claimed is: 

1. A method for selectively retrieving a stored image 
from a plurality of stored images comprising the steps 
of: 

displaying an input image with a first spatial light 
modulator; 

forming a first matrix array including replications of 
the input image on a second spatial light modula- 
tor; 

forming a second matrix array including a plurality of 
stored images at least one of which may correlate 
with said input image, said second matrix array 
being formed on the second spatial light modula- 
tor; 

forming a third matrix array of at least some of said 
stored images on a third spatial light modulator; 
and 

selectively illuminating the third matrix array to form 
an output image in response to correlation in the 
second spatial light modulator between one of said 
plurality of stored images and one of said replica- 
tions of the input image. 

2. The method of claim 1 wherein the step of display- 
ing the input image further comprises the step of: 

displaying the input image on a liquid crystal light 
valve; and 

adjusting the liquid crystal light valve to provide 
edge enhancement of the input image. 

3. The method of claim 2 wherein the liquid crystal 
light valve includes an adjustable bias frequency and an 
adjustable bias voltage and the step of adjusting the 
liquid crystal light valve to provide edge enhancement 
of the input image further comprises the steps of: 

reducing the bias frequency; and 

reducing the bias voltage of the liquid crystal light 
valve. 

4. The method of claim 2 wherein the liquid crystal 
light valve includes an adjustable bias frequency and the 
step of adjusting the liquid crystal light valve to provide 
edge enhancement of the input image further comprises 
the step of: 

reducing the bias frequency of the liquid crystal light 
valve to the range of about 500 Hz to about 2 kHz. 

5. The method of claim 2 wherein the liquid crystal 
light valve includes an adjustable bias voltage and the 
step of adjusting the liquid crystal light valve to provide 
edge enhancement of the input image further comprises 
the step of: 

reducing the bias voltage of the liquid crystal light 
valve to the range of about 5 to about 7 volts. 

6. The method of claim 2 wherein the liquid crystal 
light valve has an initial orientation and the step of 
adjusting the liquid crystal light valve to provide edge 
enhancement of the input image further comprises the 
step of: 

adjusting the orientation of the liquid crystal light 
valve in the range of about 10° to about 30°. 

7. The method of claim 2 wherein the step of selec- 
tively illuminating the third spatial light modulator to 
select an image in the third matrix array further com- 
prises the steps of: 

detecting correlation between the first and second 
matrix arrays with an array of photodetectors; and 

illuminating an array of light sources in response to 
the detected correlations to selectively apply light 
to the third spatial light modulator. 
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8. The method of claim 7 wherein the step of illumi- 
nating the array of light sources further comprises the 
step of: 

non-linearly amplifying outputs of the photodetector 
array to drive the array of light sources. 5 

9. The method of claim 1 further comprising the steps 
of: 

directing the illumination applied to the third matrix 
array to a mirror array in which mirrors corre- 
sponding to each matrix array location reflect im- 10 
ages to a central location; and 
focussing the images applied to the central location 
onto an image detector. 

10. A system for selectively retrieving a stored image 

from a plurality of stored images comprising: 15 

a first spatial light modulator for displaying an input 
image; 

a second spatial light modulator; 
means for forming a first matrix array on the second 
spatial light modulator including replications of the 20 
input image displayed on the first spatial light mod- 
ulator; 

means for forming a second matrix array including a 
plurality of stored images on the second spatial 
light modulator, said second matrix array being 25 
superimposed upon said first matrix array for cor- 
relation therewith; 
a third spatial light modulator; 
means for forming a third matrix array including at 
least some of said plurality of stored images, said 30 
third matrix array being formed on the third spatial 
light modulator; 

means for detecting a correlation above a predeter- 
mined threshold value between images in said first 
and second matrix arrays; and 35 

means for selectively illuminating the third spatial 
light modulator to form an output image related to 
said input image in response to a detected correla- 
tion. 

11. The system of claim 10 wherein the first spatial 40 
light modulator is a liquid crystal light valve, further 
comprising: 

means for adjusting the liquid crystal light valve to 
provide edge enhancement of the input image. 

12. The system of claim 11 wherein the liquid crystal 45 
light valve includes an adjustable bias frequency and an 
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adjustable bias voltage and means for adjusting the 
liquid crystal light valve to provide edge enhancement 
of the input image further comprises: 

means for reducing the bias frequency; and 

means for reducing the bias voltage. 

13. The system of claim 11 wherein the liquid crystal 
light valve includes an adjustable bias frequency and 
means for adjusting the liquid crystal light valve to 
provide edge enhancement of the input image further 
comprises: 

means for reducing the bias frequency of the liquid 
crystal light valve to the range of about 500 Hz to 
about 2 kHz. 

14. The system of claim 11 wherein the liquid crystal 
light valve includes an adjustable bias voltage and 
means for adjusting the liquid crystal light valve to 
provide edge enhancement of the input image further 
comprises: 

means for reducing the bias voltage of the liquid 
crystal light valve to the range of about 5 to about 
7 volts. 

15. The system of claim 11 wherein the liquid crystal 
light valve has an initial orientation and the means for 
adjusting the liquid crystal light valve to provide edge 
enhancement of the input image further comprises: 

means for adjusting the orientation of the liquid crys- 
tal light valve in the range of about 10# to about 
30#. 

16. The system of claim 11 wherein the means for 
selectively illuminating the third spatial light modulator 
to select an image in the third matrix array further com- 
prises: 

photodetector means for detecting correlation be- 
tween the first and second matrix arrays; 

non-linearly amplifying means for amplifying the 
outputs of the photodetector means for illuminat- 
ing the third spatial light modulator. 

17. The system of claim 10 further comprising: 

a mirror array responsive to the third spatial light 
modulator in which mirrors corresponding to each 
matrix array location reflect images to a central 
location; and 

means for detecting the images applied to the central 
location. 

***** 
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